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ABSTRACT 

The relationship between teachers’ characteristics and their pupils’ achievement has been the 
subject of many studies. Most of this research focuses on the impact of teacher salaries, experience, 
and measures of teachers’ pre-service training such as educational background. The effect of on-the- 
job or in-service training has received much less attention. In this paper, we estimate the effect of 
in-service teacher training on children’s reading and mathematics achievement in Jerusalem 
elementary schools. The training was based on pedagogical methods developed in US schools. Our 
research uses a matched-comparison design which exploits the fact that only a few schools received 
extra funds for training. Differences-in-differences, regression, and nonparametric matching 
estimates are reported. The results suggest that the training received by teachers in the non-religious 
branch of the Jerusalem school system led to an improvement in their pupils’ test scores. The 
estimates for religious schools are not clear cut, but this may be because the training program in 
religious schools started later and was implemented on a smaller scale. The estimates for non- 
religious schools suggest that, at least in this case, teacher training provided a less costly means of 
increasing test scores than reducing class size or adding school hours. 
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I. Introduction 



The question of how teacher characteristics affect pupil learning has long been of concern to 
economists, educators, and parents. The interest in this question is more than academic since many parents 
would be willing to pay for better teacher qualifications if they knew that this would cause their children to 
learn more. The widespread interest in teacher characteristics has led to numerous studies that attempt to 
estimate the effect of teachers' characteristics on their pupils’ test scores. The characteristics that have been 
most studied are teachers’ educational background, years of teaching experience, and salaries. This research, 
while plentiful, has failed to produce a consensus regarding the causal impact of teacher characteristics, and 
the question of whether ostensibly more-qualified teachers produce better students remains open (see, e.g., 
Hanushek, 1986, and Hedges, Laine, and Greenwald, 1994 for contrasting assessments of the literature). 1 

While many econometric and statistical studies have focused on the consequences of teachers’ general 
skills as captured by education or experience, a second strand of research has looked at the question of how 
specific episodes of on-the-job or in-service training affect pupil performance. On-the-job and in-service 
training are probably at least as important as the more widely-studied pre-service training or general experience 
measures. For example, one survey of research on teacher training in developing countries concludes that “Pre- 
service training is essential to teach subject matter. In-service training is essential to teach teaching skills.” 
(Farrel and Oliveira, 1993, p. 15). In spite of the importance and potential cost-effectiveness of in-service 
training, the literature on the effects of this sort of training is sparse. In a recent study that is similar in spirit 
to ours, Bressoux (1996) looks at the impact of in-service training on novice teachers in France using a quasi- 
experimental research design. Bressoux observes that most of the work on this topic to date falls into the 
category of “process evaluation” that ignores outcomes, or involves comparisons of different training programs 



'The best-known study of teacher characteristics and other school resources is probably the Coleman report (1966). 
Another early example is Mumane (1975). A recent US study of the effect of teachers’ education and experience is 
Ehrenberg and Brewer (1994). Another recent study is Behrman, Khan, Ross, and Sabot (1997), who look at teacher 
qualifications in Pakistan. Researchers have also studied the relationship between teacher’s salaries and their pupils’ 
earnings as adults. See Welch (1966) and, more recently. Card and Krueger (1992). • > 
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with no untrained control group. 2 

This paper contributes to the literature on effects of in-service training by presenting an evaluation of 
teacher training in Jerusalem elementary schools, with the purpose of estimating the causal effect of the 
program on pupils’ test scores. The training program we study was designed to improve the teaching of 
language skills and mathematics, and involves pedagogical methods developed in US schools. Most of the 
existing research on teacher training, like studies of the effects of other school resources, is complicated by 
the fact that school inputs are not exogenously determined. 3 In an attempt to overcome the methodological 
difficulties inherent in an evaluation study of this type, our research design exploits the fact that in 1995 a 
handful of public schools in Jerusalem received a special infusion of funds that were primarily earmarked for 
teachers’ on-the-job training. This program presents an unusual research opportunity because, even though the 
intervention was not allocated using experimental random assignment, the Jerusalem intervention can be 
studied with the aid of a matched group of students from schools not subject to the intervention. Considerable 
information is available on the students enrolled at the affected schools both before and after the intervention 
began. Similar information is also available for a group of comparison schools in adjacent neighborhoods and 
elsewhere in the city, so these schools can play the role of a control group. 

Our research strategy uses a variety of statistical methods to estimate the causal effect of teachers’ on- 
the-job training on their students’ test scores. All of the methods suggest that the training received by teachers 
who work in the non-religious branch of the Jerusalem school system led to an improvement in their pupils’ 



Perhaps surprisingly, there seems to have been more research on the impact of teacher training in developing countries 
than in developed countries. It should also be noted that economists have estimated the effects of teacher training in their 
own discipline. See, for example, Highsmith (1974) and Schober (1984). In-service training for graduate teaching 
assistants has been studied as well (see, e.g., Bray and Howard, 1980, or Carroll, 1980). Recent research on the 
productivity consequences of on-the-job and in-service training for workers other than teachers includes Bartel (1995) 
and Krueger and Rouse (1998). 

3 An exception is Dildy (1982), who reports the results of a randomized trial to evaluate the effects of teacher training 
in Arkansas elementary schools. The potential for bias in naive comparisons was highlighted by Lavy (1995), who noted 
that the apparent negative correlation between school inputs and pupil achievement in Israel at least partly due to the 
fact that measures of socioeconomic disadvantage are used to decide which schools get the most inputs. 

2 



o 

ERIC 



5 



BEST COPY AVAILABLE 



test scores. In contrast with the estimates for non-religious schools, however, the estimates for religious 
schools are sensitive to the details of model specification. The absence of a clear effect in religious schools 
may be because the intervention in religious schools started later and was implemented on a smaller scale. 

The most plausible estimates for non-religious schools suggest effect sizes in the range of .2-.4 
standard deviations, which is noteworthy given the modest cost of the intervention. Given the recent concern 
with the level of teacher training in subject matter (see, e.g., Boston Globe, 1998; New York Times, 1998), 
it is also noteworthy that the Jerusalem training was in pedagogy and not subject content. In an attempt to 
assess the economic value of the training program, we compare the treatment effect and costs of training to 
the effect size and costs of alternative school improvement strategies involving reductions in class size and 
lengthening the school day. This analysis suggest that teacher training may provide a less expensive strategy 
for raising test scores than reducing class size or adding school hours. 

n. The Intervention and the Data 

A. Teacher training in Jerusalem 

Beginning in 1995, the 30 Towns intervention led to a major increase in resources for schools in two 
neighborhoods in North Jerusalem (Neve Yaakov and Pis gat Zeev) as well as in other towns and cities in 
Israel. The intervention essentially came in the form of budget increases, though in some cities the money was 
earmarked for certain uses. In Jerusalem, the 30 Towns money was spent mainly on teacher training, though 
some resources were used for reorganization and for programs for children considered to have special needs, 
including immigrants/ The extra training was provided in the school on a weekly basis by outside instructors 
who focused on improving instruction techniques for Hebrew language skills (which we call “reading”), 
mathematics, and English. The goals of the intervention were to increase the pass rate from grade to grade, to 



‘The total amount involved was about $960,000 per year for elementary schools. 
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